Method and apparatus for automatically generating a terrain model for display during flight simulation

ABSTRACT

A method and apparatus are provided for automatically generating a terrain model for display during a simulated flight along a predefined mission route. The apparatus includes a mission profiler that automatically determines the area containing the mission route for which the terrain source data is required and the respective resolution of different regions within the area. The apparatus also includes an apparatus for automatically collecting the terrain source data including a search engine for automatically searching electronic collections of terrain source data to identify terrain source data covering the area containing the mission route. The apparatus also includes an image engine for processing the terrain source data into one or more predefined formats and a terrain engine for automatically compiling the processed data to create a terrain model for display during flight simulation.

FIELD OF THE INVENTION

[0001] The present invention relates generally to methods and apparatusassociated with flight simulation and, more particularly, to methods andapparatus for generating a terrain model for display during flightsimulation.

BACKGROUND OF THE INVENTION

[0002] Pilots frequently wish to simulate a mission prior to actuallyflying the mission. By simulating the mission, a pilot can becomefamiliar with the mission route and can either avoid or prepare inadvance for any portions of the mission that may require special effortor attention. In order to simulate a mission route, a pilot initiallydefines the mission route, such as by means of a mission planning system(MPS) or the like. As known to those skilled in the art, a missionplanning system receives input from a pilot that defines a plurality ofpoints along the mission route. For example, the pilot typically definesthe beginning and end point(s) of the mission as well as points alongthe route at which the aircraft will change direction. The pilot alsodefines points that identify the location of targets or other featuresof interest. In addition to merely entering the points, the pilot alsoindicates the significance of each point, such as by indicating that thepoint represents an airfield, a target, a point at which the aircraftwill change direction or the like. Based upon the plurality of pointsdefined by the pilot, the MPS constructs the mission route to includeeach of the plurality of points.

[0003] Once the pilot has defined the mission route, a terrain modeldesigner determines the area for which terrain source data will berequired. In this regard, terrain source data is typically obtained, notjust along the mission route, but for some distance on either side ofthe mission route to permit the flight simulation to continue if theaircraft deviates from the mission route. The size of the area for whichterrain source data is required is typically based, in part, upon theaircraft platform including the range of the sensors onboard theaircraft, the turning radius of the aircraft and any other aircraftparameter that affects the size of the area that will be viewed by thepilot or interrogated by the aircraft and its sensors. In this regard,some aircraft platforms are capable of gathering and analyzing moreremote sensor data than other aircraft platforms and therefore generallyrequire terrain source data to be collected for larger areas surroundingthe mission route in order to properly simulate the planned mission.

[0004] Additionally, the terrain model designer must determine theresolution with which the terrain source data should be displayed.Typically, different portions of the terrain source data are displayedat different resolutions, each of which is typically defined by theterrain model designer. In this regard, the images in the vicinity of anairfield, a target or other feature of interest are generally definedwith greater resolution than more general terrain that is somewhatremoved from the mission route.

[0005] As described above, the terrain model designer must thereforedetermine the area for which terrain source data is required and therespective resolution of each different region within the area for whichterrain source data is required in order to permit the proper images tosubsequently be generated and presented to the pilot during flightsimulation. As will be apparent, the determination of the area for whichterrain source data is required and the respective resolution of eachregion within that area is not only a time-consuming task, but is alsoprone to errors.

[0006] Based upon the definition of the area, a terrain model designerthen collects the terrain source data required to construct a terrainmodel for a simulated flight along the mission route. Among otherthings, the terrain source data includes digitized photographs of thearea over which the mission route will be flown. In addition to imagery,the terrain source data includes elevational data defining the elevationof the terrain along the mission route and feature data defining avariety of features, including obstructions, targets and the like, alongthe mission route. The terrain model designer can collect at least someof the terrain source data from terrain source data that is stored in alocal memory device. However, the terrain model designer oftentimes mustcollect additional terrain source data for areas along the mission routefor which no terrain source data is locally stored. Additionally, evenin instances in which the terrain source data is stored in a localmemory device, the terrain model designer typically canvasses othersources of terrain source data to determine the availability of terrainsource data that is of higher quality and/or more recent than theterrain source data that is stored in a local memory device. If terrainsource data that is of higher quality and/or more recent is available,the terrain model designer will generally obtain the higher qualityterrain source data for use during the flight simulation in lieu of theterrain source data that is already stored by a local memory device, butthat is of a lower quality and/or is less recent.

[0007] Electronic collections of terrain source data are maintained by avariety of sources. For example, terrain source data may be availablefrom the joint services imaging processing station (JSIPS), the GatewayData Navigator (GDN), the United States Imagery and GeospatialInformation Services (USIGS), the master environment library (MEL),weather service feeds, commercial databases and the like. For many ofthese sources, however, the terrain model designer must complete andsubmit appropriate documents requesting the terrain source data and, insome instances, must provide proof that the terrain model designer aswell as the pilots and other personnel who will have access to theterrain source data have appropriate clearances to access and view theterrain source data. As will be apparent, the process of searching,collecting and assimilating the terrain source data can also be atime-consuming process.

[0008] Once the terrain source data has been collected, the terrainsource data is generally processed in order to improve or refine theresulting image and to extract various features from the terrain sourcedata. In this regard, software programs, such as the Imagine softwarepackage by ERDAS, Inc. of Atlanta, Ga., provide many standard imageprocessing functions, such as image enhancement, image registration,image rectification, image mosaic functions and elevation extraction.Additionally, these conventional software programs providetwo-dimensional feature extraction and three-dimensional featureextrusion as well as material classification. While these conventionalsoftware programs perform the various image processing and featureextraction functions, the terrain model designer must generally providethe proper data in the correct format and must manually initiate andinteract with the software program to perform the desired imageprocessing.

[0009] Following the image processing operations, the terrain modeldesigner provides the terrain source data to a terrain modelingsoftware. The terrain modeling software compiles the terrain source datato form a terrain model. As with image processing, a variety of softwareprograms, such as the Terra Vista software package from Terrain Experts,Inc. of Tucson, Ariz., are commercially available for generating aterrain model based upon terrain source data. The terrain model can thenbe provided to a flight simulator and, more particularly, to the imagegenerator of a flight simulator for generating the necessary imagesduring a simulation of the mission by the pilot.

[0010] While the terrain model that is necessary to simulate the missionto be flown by the pilot can be constructed in the manner describedabove, the manual process of collecting and processing the terrainsource data and constructing the terrain model is time-consuming andrequires that the terrain model designer have substantial experience.For example, the terrain model designer must often locate and obtainterrain source data from a variety of different collections. Inaddition, the terrain model designer must oftentimes determine the areafor which terrain source data is to be collected and the resolution ofthe terrain source data for different regions within the area in orderto properly simulate the mission route with the desired degree ofdetail. As such, it would be desirable to develop an improved method andapparatus for generating the terrain model for display during asimulated flight along a predefined mission route that could reliablyand accurately generate the terrain model in a more efficient mannerwhile requiring less manual intervention.

SUMMARY OF THE INVENTION

[0011] A method and apparatus are provided for automatically generatinga terrain model for display during a simulated flight along a predefinedmission route. By automatically generating the terrain model, the methodand apparatus of the present invention are more efficient thanconventional techniques for generating terrain models that requireextensive manual participation. The method and apparatus of oneadvantageous embodiment also automatically collect and combine projectsource data with the terrain source data such that the resulting terrainmodel is an accurate depiction of the area through which the missionwill be flown.

[0012] The apparatus for automatically generating the terrain modelincludes a mission profiler. The mission profiler automaticallydetermines the area containing the mission route for which the terrainsource data is required. According to one embodiment, the missionprofiler includes an input for receiving data at least partiallydefining the mission route. Additionally, the mission profiler of thisembodiment includes a processing element for automatically determiningthe area containing the mission route for which terrain source data isrequired. The processing element also automatically divides the areainto a plurality of regions based upon the mission route and determinesthe respective resolution of the terrain source data for each region.

[0013] The processing element is typically capable of determining thearea and the respective resolution of regions within the area based uponpredefined criteria. In one embodiment, the input of the missionprofiler can receive adjustments to at least some of the predefinedcriteria such that the processing element will, instead, determine thearea and the respective resolution of regions within the area based uponthe adjusted criteria. The input of the mission profiler can alsoreceive data defining the aircraft platform and/or the simulatorplatform. As such, the processing element can determine the area and therespective resolution of regions within the area based at leastpartially upon the aircraft platform and/or the simulator platform. Theinput of the mission profiler can also receive data defining a pluralityof different types of points along the mission route. In thisembodiment, the processing element determines the area and therespective resolution of regions within the area based at least in partupon the different types of points along the mission route, such aspoints designating an airfield, a target or the like.

[0014] The apparatus for automatically generating a terrain model canalso include an apparatus for automatically collecting terrain sourcedata for display during flight simulation. The apparatus forautomatically collecting terrain source data includes a search enginefor automatically searching a plurality of electronic collections ofterrain source data to identify terrain source data covering the areacontaining the mission route. The apparatus for automatically collectingterrain source data also includes an input for receiving data definingthe area containing the mission route for which terrain source data isrequired and a memory device for storing the terrain source datacovering the area containing the mission route that has been identifiedby the search engine.

[0015] The memory device typically stores terrain source data from priormission routes. During the process of automatically searching theelectronic collections of terrain source data, the search enginepreferably compares the terrain source data obtained from the electroniccollection(s) with terrain source data from prior mission routes toidentify the terrain source data that is most acceptable for the flightsimulation for the mission route. For example, the search engine mayselect the terrain source data that is of the highest quality and/or isthe most recent. In one embodiment, the search engine does not initiallyobtain the terrain source data itself. Instead, the search engine ofthis embodiment obtains information representative of the terrain sourcedata that is obtainable from the electronic collection(s). Thisinformation is generally termed “metadata”. The search engine thenobtains only that terrain source data from the electronic collection(s)that is more acceptable for the flight simulation of the mission routethan the terrain source data from prior mission routes that is alreadystored by the memory device. Thus, the method and apparatus of thisembodiment only collect the additional terrain source data that isrequired to depict the area containing the mission route, therebyincreasing the efficiency with which the terrain source data iscollected.

[0016] The memory device preferably stores the terrain source data thatis obtained from the electronic collection(s). In one embodiment, thememory device can therefore include a first memory device for storinginformation representative of the terrain source data and a secondmemory device for storing the terrain source data itself.

[0017] The apparatus for automatically generating a terrain model alsoincludes an image engine for processing terrain source data into one ormore predefined formats. In this regard, the image engine automaticallygenerates processed terrain data having one of the predefined formatsand, typically, at least one of a corrected elevation model, a materialmap, vector data and a feature model.

[0018] The apparatus for automatically generating a terrain modelfurther includes a terrain engine for automatically compiling theprocessed data to create a terrain model for display during flightsimulation. In this embodiment, the terrain engine includes a dataimporter for receiving the processed data for the area containing themission route. For example, the processed data can include imagery data,elevational data, feature data and/or mission route data. The dataimporter also receives project source data defining geospecificproperties for the area containing the mission route. For example, theproject source data can include information related to vegetation and/orcultural features. The terrain engine also includes a terrain compilerfor automatically creating the terrain model for display during flightsimulation based upon a combination of both the processed data and theproject source data. The resulting terrain model can then be provided toa flight simulator and, more particularly, the image generator of aflight simulator for generating the requisite image during simulation ofthe mission.

[0019] In addition to the apparatus for automatically generating theterrain model, a corresponding method is also provided. Similarly,corresponding methods for automatically determining the flightsimulation mission profile, for automatically collecting terrain sourcedata, for automatically processing the terrain source data into one ormore predefined formats and for automatically compiling the processeddata to create a terrain model are also provided. As a result of theautomatic generation of the terrain model, the method and apparatus ofthe present invention permit the terrain model to be more efficientlygenerated with substantially less manual participation than conventionaltechniques. Additionally, the resulting terrain model should be of thehighest quality since the terrain source data that is most acceptable,typically by being of the highest quality and/or the most recent, iscollected and compiled to create the terrain model. Moreover, theterrain model may also be partially based upon project source data tofurther improve the realistic appearance of the resulting terrain model.

BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Having thus described the invention in general terms, referencewill now be made to the accompanying drawings, which are not necessarilydrawn to scale, and wherein:

[0021]FIG. 1 is a block diagram of an apparatus for automaticallygenerating a terrain model for display during a simulated flight along apredefined mission route according to one embodiment of the presentinvention;

[0022]FIG. 2 is a graphical representation of a mission route;

[0023]FIG. 3 is a graphical representation of the area containing themission route for which terrain source data is required and therespective resolution of different regions within the area as determinedby a mission profiler according to one embodiment of the presentinvention;

[0024]FIG. 4 is a flow chart illustrating the operations performed by amethod and apparatus for automatically collecting terrain source dataincluding a search engine according to one embodiment of the presentinvention;

[0025]FIG. 5 is a graphical representation of an image engine accordingto one embodiment of the present invention for processing the terrainsource data into one or more predefined formats that may be accepted bythe terrain engine;

[0026]FIG. 6 is a block diagram of a terrain engine for automaticallycompiling terrain source data and project source data to create theterrain model for display during flight simulation according to oneembodiment of the present invention; and

[0027]FIG. 7 is a block diagram illustrating an apparatus forautomatically generating the terrain model during a simulated flightalong the predefined mission route according to one embodiment of thepresent invention which includes a plurality of parallel channels.

DETAILED DESCRIPTION OF THE INVENTION

[0028] The present invention now will be described more fullyhereinafter with reference to the accompanying drawings, in whichpreferred embodiments of the invention are shown. This invention may,however, be embodied in many different forms and should not be construedas limited to the embodiments set forth herein; rather, theseembodiments are provided so that this disclosure will be thorough andcomplete, and will fully convey the scope of the invention to thoseskilled in the art. Like numbers refer to like elements throughout.

[0029] Referring now to FIG. 1, an apparatus 10 for automaticallygenerating a terrain model for display during a simulated flight along apredefined mission route is depicted. Although the upcoming flight to besimulated will be consistently referred to as a mission, the upcomingflight need not necessarily be a military exercise, but can be acommercial flight or a flight taken for other reasons, such as pleasure.The mission route can be defined in a variety of different manners.However, the mission route is commonly provided by a mission planningsystem (MPS) 12.

[0030] In order to define a mission route, a pilot initially providesthe MPS 12 with a description of the general geographic region withinwhich the mission will be flown. The MPS will then display atwo-dimensional representation of a map of the geographic region. Thepilot will then plot the mission route upon the map in a manner known tothose skilled in the art. For example, the pilot can identify specificpoints along the mission route by sequentially positioning a cursor ateach respective point and then providing an indication, such as bydepressing the enter key or the like, that the current position of thecursor identifies a point along the mission route. Based upon thelocation of the points identified upon the map, the MPS can determinethe latitude and longitude of each point to facilitate construction ofthe mission route. Instead of selecting points upon the map to beindicative of points along the mission route, however, the pilot candirectly enter the latitude and longitude of points along the missionroute, if known.

[0031] Based upon the points identified by the pilot, the MPS 12constructs the mission route as depicted in FIG. 2. In addition tomerely designating points along the route for purposes of theconstruction of the mission route, the pilot can identifycharacteristics associated with each of the points. For example, thepilot can indicate if the point represents the location of an airfield,such as the airfield from which the aircraft is taking off and/orlanding. Additionally, the pilot can indicate points along the missionroute that are targets as well as points along the mission route atwhich the aircraft will turn or otherwise change course. The MPS recordsthe additional information associated with respective points along themission route. Additionally, the MPS can display icons associated witheach point along the mission route to represent the characteristicsassociated with the point. For example, the MPS can present pointsassociated with the starting point, targets and turns with differenticons, such as the home plate and square icons, the triangular icon andthe circular icon, respectively, in FIG. 2.

[0032] Once the pilot, in conjunction with the MPS 12, has defined themission route, the MPS provides the mission route to the apparatus 10 ofthe present invention such that a terrain model can be automaticallygenerated for subsequent display during a simulated flight along thepredefined mission route. In this regard, the MPS typically provides theapparatus with the coordinates that define the various segments of themission route as well as data defining characteristics associated withthe respective points as described above. As shown in FIG. 1, theapparatus of the present invention includes a mission profiler 14 thatinitially receives the data provided by the MPS that defines the missionroute. The mission profiler automatically determines the area thatcontains the mission route for which terrain source data is required.That is, the mission profiler automatically identifies the area alongthe mission route as well as areas in the vicinity of the route that maybe viewed during flight simulation, either by the pilot or by onboardsensors, and for which terrain source data is required.

[0033] The automated mission profiler 14 includes an input 16 forreceiving data at least partially defining the mission route. In thisregard, the input receives data from the MPS 12 that defines the missionroute entered by the pilot, typically in terms of the coordinates ofpoints along the mission route as well as characteristics associatedwith various ones of the points. The automated mission profiler alsoincludes a processing element 18 for automatically determining the areacontaining the mission route for which imagery data is required. Theprocessing element automatically determines the area for which terrainsource data is required based upon a plurality of parameters. Forexample, the processing element can determine the area for which terrainsource data is required based, at least in part, upon data defining theaircraft platform and/or the simulator platform. In this regard, thedata defining the aircraft platform generally includes data defining theranges of the various sensors onboard the aircraft, data defining theturning radius of the aircraft at various speeds and other data thatdefines parameters that could effect the area that the pilot will viewor the onboard sensors or subsystems will interrogate during thesubsequent flight simulation. In this regard, aircraft platforms havingsensors with larger ranges will generally require the mission profilerto define a larger area than aircraft platforms having sensors withsmaller ranges. Likewise, aircraft platforms having a larger turningradius will generally dictate that the mission profiler define a largerarea for those portions of the area in which the aircraft will turn thanaircraft platforms with a smaller turning radius. For each differentaircraft platform, the mission profiler is therefore typically designedto define an area of a predetermined size, typically by extending bothstarboard and port from the mission route by a predefined distance.

[0034] The mission profiler 14 also defines the area for which terrainsource data is required based upon the different types of points alongthe mission route. Therefore, for a respective aircraft platform, themission profiler generally defines the area to extend a predefineddistance to both the starboard and the port sides of the aircraft fromthe mission route. The mission profiler then modifies the area for whichterrain source data is required based upon the different types of pointsalong the mission route. For example, the area for which terrain sourcedata is required is generally increased in regions surrounding thepoints that are indicative of a turn or a change in course of themission route. For example, based upon a respective aircraft platformtraveling at a predetermined speed, the mission profiler preferablyincreases the area by a predetermined amount in those regions in whichthe aircraft will turn. Based upon the mission route including theplurality of different types of points along the mission route and theaircraft platform, the mission profiler therefore refines the area forwhich terrain source data is required.

[0035] The processing element 18 of the mission profiler 14 alsoautomatically divides the area into a plurality of regions based uponthe mission route and determines a respective resolution of the terrainsource data for each region. In this regard, the mission profilergenerally defines a predetermined baseline resolution for the terrainsource data, typically in units of meters or submeters. For certainregions of the area, however, the mission profiler will dictate that theterrain source data be provided with increased resolution in order topermit the pilot to view additional details of the region during thesubsequent flight simulation. For example, those regions that surround atarget or an airfield preferably have a greater resolution.

[0036] By way of example, a graphical depiction of the area for whichterrain source data will be provided in conjunction with the missionroute of FIG. 2 is depicted in FIG. 3. The graphical display of FIG. 3also indicates that the area for which terrain source data is providedhas been divided into two regions of different resolution. In thisregard, the centrally located tiles having a lighter color have agreater resolution than the surrounding tiles having a darker color. Forpoint of reference, the mission route is also plotted upon the graphicalrepresentation of the area for which terrain source data is provided tographically depict relative sizes of the area for which imagery datawill be provided with respect to the mission route.

[0037] The mission profiler 14 preferably defines each region to have arespective resolution. However, the input 16 of the mission profiler canalso receive data defining the simulated platform upon which the terrainmodel constructed from the terrain source data will subsequently bedisplayed. As known to those skilled in the art, a flight simulatorgenerally has an image generator that receives and processes a terrainmodel to produce the plurality of images displayed for the pilot duringflight simulation. The image generators of different types of flightsimulators have different processing capabilities. As such, the dataprovided to the mission profiler regarding the simulator platformprovides an indication of the processing capabilities of the imagegenerator. In instances in which the data indicates that the imagegenerator of the flight simulator will be unable to effectively processa terrain model having increased resolution, the mission profiler willgenerally reduce the resolution of at least some and, more typically,all of the regions such that the resulting terrain model can beprocessed by the image generator. By somewhat reducing the resolution ofat least some of the regions, the mission profiler prevents thegeneration of unnecessarily high resolution terrain models that will gounused by the flight simulator.

[0038] As described above, the mission profiler 14 is configured todefine an area of a predetermined size relative to the mission route andto divide the area into regions of different predetermined resolutions,also based upon predefined criteria. The mission profiler of oneadvantageous embodiment permits a technician, a pilot or the like toadjust the predefined criteria, however, in order to adjust the size ofthe area for which terrain source data will be provided and to adjustthe respective resolutions of different regions within the area. Forexample, a pilot may enlarge the area and increase the resolution ofeach region within the area by a predetermined percentage in order tomake the subsequent flight simulation even more realistic.

[0039] The input 16 and the processing element 18 of the missionprofiler 14 are typically comprised of a processor or other type ofcomputing device for executing a computer program that provides thefunctionality of the mission profiler as described above. The computerprogram can be either embedded within the processing element or may bestored by a memory device external to and accessible by the processor orother computing device.

[0040] Once the mission profiler 14 has determined the area for whichterrain source data is required and the respective resolution ofdifferent regions within the area, the mission profiler provides thisinformation to an apparatus 20 for automatically collecting terrainsource data for display during flight simulation. See FIG. 1. In thisregard, the apparatus for automatically collecting terrain source dataincludes an input 22 for receiving the data provided by the missionprofiler that defines the area containing the mission route for whichterrain source data is required. Additionally, the input preferablyreceives the data provided by the mission profiler that defines therespective resolution of different regions within the area. See block 50of FIG. 4.

[0041] The apparatus 20 for automatically collecting terrain source dataalso includes a search engine 24 for automatically searching a pluralityof electronic collections 25 of terrain source data to identify terrainsource data covering the area containing the mission route. See block52. As known to those skilled in the art, a variety of electroniccollections of terrain source data are maintained, both by governmentaland commercial entities. Although the search engine can search any ofthe electronic collections of terrain source data, the search enginepreferably searches those collections that have been approved by thenational agencies. In one embodiment, for example, the search enginesearches the electronic collections of terrain source data maintained byJSIPS, USIGS and MEL. In addition, the search engine of this embodimentcan search the electronic collection of terrain source data provided bythe National Weather Service, the United States Geological Survey (USGS)and by commercial satellites, such as IKONOS, LandSat, SPOT and thelike.

[0042] The search engine 24 searches the electronic collections 25 ofterrain source data to identify terrain source data that covers all, orat least the greatest percentage of, the area containing the missionroute. In searching the electronic collections of terrain source data,the search engine will oftentimes identify terrain source datamaintained by different electronic collections that depict the sameportion of the area. In these instances, the search engine reviews theterrain source data from each electronic collection and selects theterrain source data that is of the highest quality and is most recent.For example, the search engine will select a digital photograph of aportion of the area taken on a clear day in the past week instead of adigital photograph of the same portion of the area taken on an overcastday two months ago, assuming that the mission is intended to beperformed on a clear day. As such, the digital photograph taken on aclear day will be more representative of the situation with which thepilot will actually be confronted during the flight.

[0043] In addition to the search engine 24, the apparatus 20 forautomatically collecting terrain source data also includes a memorydevice 26. Among other things, the memory device preferably storesterrain source data from prior mission routes. As such, the searchengine not only searches the electronic collections 25 of terrain sourcedata maintained by governmental and commercial entities, but alsopreferably searches the memory device for terrain source data coveringall or a portion of the area for which terrain source data is required.In instances in which the memory device includes terrain source data forat least a portion of the area for which terrain source data isrequired, the search engine preferably also searches the electroniccollections of terrain source data maintained by governmental andcommercial entities to determine if the terrain source data maintainedby these electronic collections is of higher quality or more recent thanthe terrain source data stored by the memory device. If the electroniccollections of terrain source data maintained by governmental orcommercial entities is of higher quality than the terrain source datastored by the associated memory device, the search engine will obtainthe terrain source data from the electronic collections and, as such,will not use the terrain source data stored by the memory device. If,however, the terrain source data stored by the memory device is of equalto or better quality than the terrain source data maintained by theelectronic collections, the search engine will not obtain the data fromthe electronic collections and will, instead, utilize the terrain sourcedata stored by the memory device since the terrain source data stored bythe memory device can be accessed more efficiently. See blocks 56 and 58of FIG. 4.

[0044] Typically, the search engine 24 does not initially obtain theterrain source data. Instead, the search engine preferably initiallyobtains information representative of the terrain source data. Thisinformation that is representative of the terrain source data iscommonly termed “metadata”. The metadata typically defines thegeographical region covered by the associated terrain source data andindicates the type of terrain source data, such as a digital photographor the like, and the date on which the terrain source data was obtained.In addition, the metadata may provide an indication of the conditionsunder which the terrain source data was obtained, such as cloudy, clear,rainy or the like. See block 54 of FIG. 4. Based upon the metadata, thesearch engine can identify terrain source data that covers the entirearea for which terrain source data is required and can determine theterrain source data that will provide the highest quality image of thearea.

[0045] By initially obtaining and reviewing information, such asmetadata, representative of the terrain source data, however, the searchengine 24 can more efficiently perform the search and analysis processthan if the search engine obtained the terrain source data itself. Inthis regard, the metadata is typically a much smaller quantity of datathan the associated terrain source data. As such, the metadata can bemuch more efficiently transferred and analyzed than the terrain sourcedata.

[0046] Once a search engine 24 identifies the terrain source datamaintained by one or more electronic collections 25 that is required inorder to provide the highest quality terrain source data for the area,the terrain source data is obtained and stored by the memory device 26.See block 60. Although the memory device can be constructed in variousmanners, the memory device is typically comprised of first and secondmemory devices 26 a, 26 b. In this regard, the first memory device, suchas a simple query language (SQL) database, typically stores theinformation, such as the metadata, representative of the terrain sourcedata, while a second memory device, such as a mass storage system,stores the terrain source data itself. In order to efficiently locatethe terrain source data within the second memory device, the firstmemory device can also store pointers or addresses for identifying theterrain source data associated with the metadata.

[0047] The input 22 and the search engine 24 are typically comprised ofcomputer software that is supported and executed by a dedicated server.However, the computer software that generally comprises the input andthe search engine can be supported and executed by a processor or othercomputing device, if so desired.

[0048] Once the terrain source data has been collected, the method andapparatus 10 of the present invention automatically process the terrainsource data to refine the resulting image and to extract variousfeatures therefrom. As a result of this processing, the terrain sourcedata is transformed into one or more predefined formats that can besubsequently accepted by the terrain engine, as described below. Thisautomatic processing is typically performed by an image engine with thecomputer software that embodies the image engine typically beingsupported and executed by a processor or other computing device.

[0049] While the image engine 28 can perform any of a variety ofconventional image processing techniques in order to refine theresulting data, the image engine of one embodiment performs an imageenhancement function as shown in block 70 of FIG. 5 in order to performatmospheric corrections. Additionally, the image engine can performimage registration of the enhanced image in order to register the imagesto fixed points. See block 72. Furthermore, the image engine can providean elevation extraction function in order to generate an elevationmodel. See block 74. In this regard, the image engine or a memory deviceassociated therewith typically includes a relatively low resolutionelevation model of at least the geographic region surrounding themission route. Based upon stereo pairs of the terrain source data, suchas pairs of digital photographs that at least partially overlap, theelevation extraction function can extract elevation information in orderto revise the low resolution elevation model to include the elevation offeatures above ground level, such as trees, buildings and the like.

[0050] Further, the image engine 28 can perform image rectification uponthe registered image in order to remove image distortion and to make theresulting image square. See block 76 of FIG. 5. Following imagerectification, the image engine can perform an image resolution merge inwhich the resulting image produced by the image rectification functionis merged with low resolution imagery, typically provided by the secondmemory device 26 b. See block 77. As such, higher resolution black andwhite images may be combined with lower resolution color images tocreate higher resolution color images. The image engine then performs animage mosaic function in order to merge a plurality of overlappingimages and an image tonal balance function to balance the colorstherebetween, thereby creating the resulting imagery data. See blocks 78and 79.

[0051] Additionally, a material set 80 that defines the different typesof materials, such as concrete, trees, wood, etc., that may be visiblein the imagery data is provided. Based upon the imagery data and thematerial set, the image engine can perform a material classificationfunction in order to generate a material map that defines the materialtype of various features in the imagery data. See block 82. The materialmap can then be provided to the various simulated sensors, such as theradar and the infrared sensors, onboard the aircraft platform such thatthe readings of the sensors will properly simulate actual flightconditions. The image engine can also extract two-dimensional featuresfrom the terrain source data in order to generate vector data based uponnot only the terrain source data, but also the material map and lowresolution feature data, typically provided by the second memory device26 b. See block 84. The two-dimensional feature data generally definesthe features present in the imagery data when viewed from above. Thisvector data can be utilized to correct the elevation model in order toremove features that extend above ground level to generate a correctedelevation model representative of the elevation of the terrain itself,and not buildings, trees and the like that extend above ground level.See block 86. Finally, the image engine can perform a three-dimensionalculture generation based upon the imagery data, the vector data and theoutput of the elevation extraction function in order to perform athree-dimensional feature extrusion function, thereby generating featuremodels. See block 88. In this regard, the three-dimensional featureextrusion function generates three-dimensional models of variousfeatures, such as trees, buildings, bridges and the like, that arerepresented in two-dimensions in the imagery data. The three-dimensionalmodels can then be utilized to provide a more realistic simulation. Theimage engine of this embodiment therefore generates imagery data, acorrected elevation model, vector data, a feature model and a materialmap, each of which are stored by the memory device 26, moreparticularly, by the second memory device 26 b.

[0052] While the individual image processing functions described abovemay be separately performed by a commercial software package entitledImagine available from ERDAS, Inc. of Atlanta, Ga., the foregoing imageprocessing functions have not previously been performed in an automatedand integrated manner than minimizes, if not eliminates, manualinteraction as provided by the image engine of the present invention. Inaddition, while one exemplary set of image processing functions has beendescribed above, the method and apparatus 10 of the present inventioncan include other types of image engines 28 for performing a differentsequence or set of image processing functions, if so desired.

[0053] The method and apparatus 10 of the present invention alsoincludes a terrain engine 30 for compiling the processed data followingimage processing to create a terrain model for display during asubsequent flight simulation. As shown in FIG. 6, the terrain engineincludes a data importer 32 for receiving processed data for the areacontaining the mission route. As described above, the processed data caninclude imagery data and one or more of a corrected elevation model,vector data, feature models and a material map. According to oneadvantageous embodiment, the data importer also receives project sourcedata. The project source data has typically been previously stored inthe memory device 26 and defines geospecific properties for the areacontaining the mission route. For example, the project source data caninclude information related to vegetation and information related tocultural features. The information related to vegetation may indicatethat the area includes a large number of a particular type of treehaving a specific color. As such, the color of the resulting image canbe adjusted to ensure that the vegetation is properly depicted.Similarly, the information related to cultural features can include datathat indicates that the area is chiefly covered by sand having aparticular color. As such, the color of the resulting image can also beadjusted to ensure that the sand is properly depicted in order to permita more realistic image to be generated. In addition to the dataimporter, the terrain engine also generally includes a terrain compiler34 for combining the processed data and the project source data tocreate a terrain model that is stored in a database 35. In this regard,the terrain model is preferably stored in the format that will beacceptable to the simulation platform that will subsequently process anddisplay the terrain model.

[0054] In addition to providing a terrain model, the terrain engine 30can include a radar compiler for further processing the terrain model togenerate a radar model that can utilized during a subsequent flightsimulation to provide a corresponding radar display. The terrain enginecan include any radar compiler known to those skilled in the artincluding the Multimode Radar Simulator of The Boeing Company.

[0055] The terrain engine 30 is typically comprised of a softwareprogram, such as the Terra Vista software package provided by TerrainExperts, Inc., that has been modified to accept and process projectsource data in addition to terrain source data. The computer softwarecan be executed upon a variety of platforms, including a processor orother types of computing devices.

[0056] Regardless of its implementation, the terrain engine 30 canprovide the terrain model to the flight simulator 36 in a variety ofmanners. In one embodiment depicted in FIG. 1, the apparatus 10 includesa compression unit 38 for compressing the terrain model, such as bymeans of wavelet compression or other conventional compressiontechniques, prior to being transmitted to a remote flight simulator, viaeither wired or wireless communication links. Upon receipt, adecompression unit 40 decompresses the terrain model and thedecompressed terrain model is then stored. During a subsequent flightsimulation, the terrain model can be provided to the image generator ofthe flight simulator in order to generate a realistic image of the areain which the mission route will be flown.

[0057] In order to further increase the efficiency with which the methodand apparatus 10 of the present invention automatically generate theterrain model, the apparatus can be configured as depicted in FIG. 7 inorder to perform a variety of the functions in parallel. In this regard,the apparatus can include a plurality of search engines 24 disposed inparallel for concurrently searching a plurality of different electroniccollections 25 of terrain source data. Additionally, the apparatus caninclude a plurality of parallel image engines 28 in order toconcurrently perform different image processing functions. Stillfurther, the apparatus can include a plurality of terrain engines 30 forcompiling or combining the terrain source data and the project sourcedata for a variety of different terrain models at the same time. Inaddition to increasing the efficiency with which terrain models can begenerated, the embodiment of the apparatus depicted in FIG. 7 isscalable so that additional search, image and terrain engines can beadded as the demand increases. In addition, the search, image andterrain engines are preferably hot swappable in order to permitcontinuous processing, even in instances in which one of the enginesfails.

[0058] As also depicted in FIG. 7, the method and apparatus 10 caninclude a resource manager 42, also typically embodied by a computerprogram that is executed by a processor or other computing device, forallocating or scheduling the plurality of tasks to different ones of thesearch, image and terrain engines. In this regard, the resource managertypically receives the definition of the areas for which terrain sourcedata is required and the respective resolutions of different regionswithin the areas from the mission profiler 14. The resource managerincludes a queue 44 for maintaining a prioritized list of the pluralityof tasks required to generate a terrain model for each area defined bythe mission profiler. These tasks include identifying terrain sourcedata covering each of the areas, processing the terrain source data andcompiling the processed data and any project source data to generaterespective terrain models. Additionally, the resource manager includes atask pipeline 46 for assigning respective tasks to different ones of thesearch, image and terrain engines in order to perform the respectivetasks in the most efficient manner as known to those skilled in the art.

[0059] As a result of the automatic generation of the terrain model, themethod and apparatus 10 of the present invention permit the terrainmodel to be more efficiently generated with substantially less manualparticipation than conventional techniques. Additionally, the resultingterrain model should be of the highest quality since the terrain sourcedata that is most acceptable, typically by being of the highest qualityand/or the most recent, is collected and compiled to create the terrainmodel. Moreover, the terrain model may also be partially based uponproject source data to further improve the realistic appearance of theresulting terrain model.

[0060] Many modifications and other embodiments of the invention willcome to mind to one skilled in the art to which this invention pertainshaving the benefit of the teachings presented in the foregoingdescriptions and the associated drawings. Therefore, it is to beunderstood that the invention is not to be limited to the specificembodiments disclosed and that modifications and other embodiments areintended to be included within the scope of the appended claims.Although specific terms are employed herein, they are used in a genericand descriptive sense only and not for purposes of limitation.

That which is claimed:
 1. An apparatus for automatically generating aterrain model for display during a simulated flight along a predefinedmission route, the apparatus comprising: a mission profiler forautomatically determining an area containing the mission route for whichterrain source data is required; a search engine for automaticallysearching a plurality of electronic collections of terrain source datato identify terrain source data covering the area containing the missionroute; an image engine for processing terrain source data into one ormore predefined formats; and a terrain engine for automaticallycompiling the processed data to create a terrain model for displayduring flight simulation.
 2. An apparatus according to claim 1 whereinsaid mission profiler comprises an input for receiving data at leastpartially defining a mission route.
 3. An apparatus according to claim 2wherein said mission profiler comprises a processing element forautomatically dividing the area into a plurality of regions based uponthe mission route and determining a respective resolution of the terrainsource data for each region.
 4. An apparatus according to claim 3wherein said input also receives data defining at least one of anaircraft platform and a simulator platform, and wherein said processingelement determines the area and the respective resolution of regionswithin the area based at least partially upon at least one of theaircraft platform and the simulator platform.
 5. An apparatus accordingto claim 3 wherein said input receives data defining a plurality ofdifferent types of points along the mission route, and wherein saidprocessing element determines the area and the respective resolution ofregions within the area based at least partially upon the differenttypes of points along the mission route.
 6. An apparatus according toclaim 3 wherein said processing element is capable of determining thearea and the respective resolution of regions within the area based uponpredefined criteria, and wherein said input is adapted to receiveadjustments to at least some of the predefined criteria such that saidprocessing element determines the area and the respective resolution ofregions within the area based upon the adjusted criteria.
 7. Anapparatus according to claim 1 further comprising a memory device forstoring the terrain source data covering the area containing the missionroute identified by the search engine to facilitate display duringflight simulation.
 8. An apparatus according to claim 7 wherein saidmemory device stores terrain source data from prior mission routes. 9.An apparatus according to claim 8 wherein said search engine comparesterrain source data obtained from an electronic collection of terrainsource data with terrain source data from prior mission routes todetermine the terrain source data that is most acceptable for the flightsimulation of the mission route.
 10. An apparatus according to claim 9wherein said search engine obtains information representative of theterrain source data that is obtainable from the electronic collection ofterrain source data, wherein said search engine obtains the terrainsource data from the electronic collection of terrain source data thatis more acceptable for the flight simulation of the mission route thanterrain source data from prior mission routes, and wherein said memorydevice stores the terrain source data obtained from the electroniccollection.
 11. An apparatus according to claim 10 wherein said memorydevice comprises: a first memory device for storing the informationrepresentative of the terrain source data; and a second memory devicefor storing the terrain source data.
 12. An apparatus according to claim1 wherein said image engine automatically generates processed terraindata having one of the predefined formats and at least one of acorrected elevation model, a material map, vector data and a featuremodel.
 13. An apparatus according to claim 1 wherein said terrain enginecomprises a data importer for receiving the processed data for an areacontaining a mission route, said data importer also receiving projectsource data defining geospecific properties for the area containing themission route.
 14. An apparatus according to claim 13 wherein saidterrain engine further comprises a terrain compiler for automaticallycreating the terrain model for display during flight simulation basedupon a combination of both the processed data and the project sourcedata.
 15. An apparatus according to claim 13 wherein said data importerreceives project source data selected from the group consisting ofinformation related to vegetation and information related to culturalfeatures.
 16. An apparatus according to claim 13 wherein said dataimporter receives processed data from said image engine that is selectedfrom the group consisting of imagery data, elevational data, featuredata and mission route data.
 17. A method for automatically generating aterrain model for display during a simulated flight along a predefinedmission route, the method comprising: automatically determining an areacontaining the mission route for which terrain source data is required;automatically searching a plurality of electronic collections of terrainsource data to identify terrain source data covering the area containingthe mission route; processing terrain source data into one or morepredefined formats; and automatically compiling the processed data tocreate a terrain model for display during flight simulation.
 18. Amethod according to claim 17 further comprising receiving data at leastpartially defining a mission route prior to determining the areacontaining the mission route.
 19. A method according to claim 18 whereindetermining the area comprises automatically dividing the area into aplurality of regions based upon the mission route and determining arespective resolution of the terrain source data for each region.
 20. Amethod according to claim 19 further comprising receiving data definingat least one of an aircraft platform and a simulator platform, andwherein determining the area and the respective resolution of regionswithin the area is based at least partially upon at least one of theaircraft platform and the simulator platform.
 21. A method according toclaim 19 further comprising defining a plurality of different types ofpoints along the mission route, and wherein determining the area and therespective resolution of regions within the area is based at leastpartially upon the different types of points along the mission route.22. A method according to claim 19 wherein determining the area and therespective resolution of regions within the area is based uponpredefined criteria, and wherein the method further comprises receivingadjustments to at least some of the predefined criteria such that thearea and the respective resolution of regions within the area are basedupon the adjusted criteria.
 23. A method according to claim 17 furthercomprising storing the terrain source data covering the area containingthe mission route identified by the search engine to facilitate displayduring flight simulation.
 24. A method according to claim 23 whereinstoring the terrain source data comprises storing terrain source datafrom prior mission routes.
 25. A method according to claim 24 whereinautomatically searching the electronic collections of terrain sourcedata comprises comparing terrain source data obtained from an electroniccollection of terrain source data with terrain source data from priormission routes to determine the terrain source data that is mostacceptable for the flight simulation of the mission route.
 26. A methodaccording to claim 25 wherein automatically searching the electroniccollections of terrain source data further comprises obtaininginformation representative of the terrain source data that is obtainablefrom the electronic collection of terrain source data and obtaining theterrain source data from the electronic collection of terrain sourcedata that is more acceptable for the flight simulation of the missionroute than terrain source data from prior mission routes, and whereinstoring the terrain source data comprises storing the terrain sourcedata obtained from the electronic collection.
 27. A method according toclaim 17 wherein processing the terrain source data comprisesautomatically generating processed terrain data having one of thepredefined formats and at least one of a corrected elevation model, amaterial map, vector data and a feature model.
 28. A method according toclaim 17 wherein automatically compiling the processed data comprisesreceiving both the processed data for an area containing a mission routeand project source data defining geospecific properties for the areacontaining the mission route.
 29. A method according to claim 28 whereinautomatically compiling the processed data further comprisesautomatically creating the terrain model for display during flightsimulation based upon a combination of both the processed data and theproject source data.
 30. A method according to claim 28 whereinreceiving project source data comprises receiving project source dataselected from the group consisting of information related to vegetationand information related to cultural features.
 31. A method according toclaim 28 wherein receiving processed data comprises receiving processeddata selected from the group consisting of imagery data, elevationaldata, feature data and mission route data.
 32. An automated flightsimulation mission profiler comprising: an input for receiving data atleast partially defining a mission route; and a processing element forautomatically determining an area containing the mission route for whichterrain source data is required, said processing element alsoautomatically dividing the area into a plurality of regions based uponthe mission route and determining a respective resolution of the terrainsource data for each region.
 33. An automated flight simulation missionprofiler according to claim 32 wherein said input also receives datadefining at least one of an aircraft platform and a simulator platform,and wherein said processing element determines the area and therespective resolution of regions within the area based at leastpartially upon at least one of the aircraft platform and the simulatorplatform.
 34. An automated flight simulation mission profiler accordingto claim 32 wherein said input receives data defining a plurality ofdifferent types of points along the mission route, and wherein saidprocessing element determines the area and the respective resolution ofregions within the area based at least partially upon the differenttypes of points along the mission route.
 35. An automated flightsimulation mission profiler according to claim 32 wherein saidprocessing element is capable of determining the area and the respectiveresolution of regions within the area based upon predefined criteria,and wherein said input is adapted to receive adjustments to at leastsome of the predefined criteria such that said processing elementdetermines the area and the respective resolution of regions within thearea based upon the adjusted criteria.
 36. An automated method fordetermining a flight simulation mission profile comprising: receivingdata at least partially defining a mission route; automaticallydetermining an area containing the mission route for which terrainsource data is required; and automatically dividing the area into aplurality of regions based upon the mission route and determining arespective resolution of the terrain source data for each region.
 37. Amethod according to claim 36 further comprising receiving data definingat least one of an aircraft platform and a simulator platform, andwherein automatically determining the area and the respective resolutionof regions within the area is based at least partially upon at least oneof the aircraft platform and the simulator platform.
 38. A methodaccording to claim 36 further comprising receiving data defining aplurality of different types of points along the mission route, andwherein automatically determining the area and the respective resolutionof regions within the area is based at least partially upon thedifferent types of points along the mission route.
 39. A methodaccording to claim 36 wherein automatically determining the area and therespective resolution of regions within the area is based uponpredefined criteria, and wherein the method further comprises receivingadjustments to at least some of the predefined criteria such that thearea and the respective resolution of regions within the area aredetermined based upon the adjusted criteria.
 40. An apparatus forautomatically collecting terrain source data for display during flightsimulation, the apparatus comprising: an input for receiving datadefining an area containing a mission route for which terrain sourcedata is required; a search engine for automatically searching aplurality of electronic collections of terrain source data to identifyterrain source data covering the area containing the mission route; anda memory device for storing the terrain source data covering the areacontaining the mission route identified by the search engine tofacilitate display during flight simulation.
 41. An apparatus accordingto claim 40 wherein said memory device stores terrain source data fromprior mission routes.
 42. An apparatus according to claim 41 whereinsaid search engine compares terrain source data obtained from anelectronic collection of terrain source data with terrain source datafrom prior mission routes to determine the terrain source data that ismost acceptable for the flight simulation of the mission route.
 43. Anapparatus according to claim 42 wherein said search engine obtainsinformation representative of the terrain source data that is obtainablefrom the electronic collection of terrain source data, wherein saidsearch engine obtains the terrain source data from the electroniccollection of terrain source data that is more acceptable for the flightsimulation of the mission route than terrain source data from priormission routes, and wherein said memory device stores the terrain sourcedata obtained from the electronic collection.
 44. An apparatus accordingto claim 43 wherein said memory device comprises: a first memory devicefor storing the information representative of the terrain source data;and a second memory device for storing the terrain source data.
 45. Amethod for automatically collecting terrain source data for displayduring flight simulation, the method comprising: receiving data definingan area containing a mission route for which terrain source data isrequired; automatically searching a plurality of electronic collectionsof terrain source data to identify terrain source data covering the areacontaining the mission route; and storing the terrain source datacovering the area containing the mission route identified by the searchengine to facilitate display during flight simulation.
 46. A methodaccording to claim 45 wherein storing the terrain source data comprisesstoring terrain source data from prior mission routes.
 47. A methodaccording to claim 46 wherein automatically searching the plurality ofelectronic collections of terrain source data comprises comparingterrain source data obtained from an electronic collection of terrainsource data with terrain source data from prior mission routes todetermine the terrain source data that is most acceptable for the flightsimulation of the mission route.
 48. A method according to claim 47wherein automatically searching the plurality of electronic collectionsof terrain source data further comprises obtaining informationrepresentative of the terrain source data that is obtainable from theelectronic collection of terrain source data, and obtaining the terrainsource data from the electronic collection of terrain source data thatis more acceptable for the flight simulation of the mission route thanterrain source data from prior mission routes, and wherein storing theterrain source data comprises storing the terrain source data obtainedfrom the electronic collection.
 49. A terrain engine for automaticallycompiling terrain source data to create a terrain model for displayduring flight simulation, the terrain engine comprising: a data importerfor receiving the terrain source data for an area containing a missionroute, said data importer also receiving project source data defininggeospecific properties for the area containing the mission route; and aterrain compiler for automatically creating the terrain model fordisplay during flight simulation based upon a combination of both theterrain source data and the project source data.
 50. A terrain engineaccording to claim 49 wherein said data importer receives project sourcedata selected from the group consisting of information related tovegetation and information related to cultural features.
 51. A terrainengine according to claim 49 wherein said data importer receives terrainsource data selected from the group consisting of imagery data,elevational data, feature data and mission route data.
 52. A method forautomatically compiling terrain source data to create a terrain modelfor display during flight simulation, the method comprising: receivingthe terrain source data for an area containing a mission route;receiving project source data defining geospecific properties for thearea containing the mission route; and automatically creating theterrain model for display during flight simulation based upon acombination of both the terrain source data and the project source data.53. A method according to claim 52 wherein receiving the project sourcedata comprises receiving project source data selected from the groupconsisting of information related to vegetation and information relatedto cultural features.
 54. A method according to claim 52 whereinreceiving the terrain source data comprises receiving terrain sourcedata selected from the group consisting of imagery data, elevationaldata, feature data and mission route data.